1 VIDEO AND DIGITAL MULTIMEDIA AGGREGATOR 

2 Related Applications 

3 The following U.S. Patents also are incorporated by reference: 

4 U.S. Patent 5,798,785, entitled "Terminal for Suggesting Programs Offered on a 

5 Television Program Delivery System;" 

6 U.S. Patent 5,986,690, entitled "Electronic Book Selection and Delivery System;" 

7 The following co-pending U.S. patent applications also are incorporated by reference: 

8 patent application serial number 07/991,074, filed December 9, 1992, entitled 

9 "Remote Control for Menu Driven Subscriber Access to Television Programming;" 

10 patent application serial number 08/906,469, filed August 5, 1997, entitled 

11 "Reprogrammable Terminal for Suggesting Programs Offered on a Television Program 

12 Delivery System;" 

13 patent application serial number 09/191,520, filed November 13, 1998, entitled 

14 "Digital Broadcast Program Ordering;" 

15 patent application serial number 09/289,957, filed April 13, 1999, entitled "Electronic 

1 6 Book Alternative Delivery Systems;" 

17 patent application serial number 09/289,956, filed April 13, 1999, entitled "Electronic 

1 8 Book Alternative Delivery Methods;" and 

19 patent application entitled "Video and Digital Multimedia Aggregator;" and patent 

20 application entitled "Video and Digital Multimedia Aggregator Remote Content Crawler," 

2 1 filed on date herein. 

22 Technical Field 

23 The technical field is television program and digital multimedia delivery systems that 

24 incorporate intelligent and flexible program search and delivery mechanisms. 

25 Background 

26 Cable television delivery systems greatly expanded the array of programs available to 

27 television viewers over that provided by over-the-air broadcast systems. Subsequently, 

28 satellite television delivery systems, and in particular, digital satellite broadcast systems 

29 further expanded the viewing choices for consumers. In the near future, digital broadcast 

30 television systems will provide many more programming choices for consumers. 
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1 In addition to television programming delivered through television program delivery 

2 systems, other programs and events may be sent to consumers. These other programs and 

3 events include streaming video sent over wired and unwired, narrowband to broadband 

4 services, digital audio programs, and other multimedia data. 

5 Unfortunately, customers are still limited in their television viewing choices by the 

6 local and regional nature of television delivery systems. For example, a broadcaster in 

7 Boston may provide programming of local interests to people in Massachusetts while a 

8 broadcaster in Seattle may provide different programming to people in the Seattle area. A 

9 person in Boston generally cannot access Seattle programming, other than programming that 

10 is provided at a national level. 

11 In addition to this local/regional market segregation, many other sources of 

12 programming and events may not be available in a specific viewing area. These other 

13 sources may include audio programming, streaming video, local or closed circuit television 

14 programming (e.g., education television programming provided by a state education 

1 5 department) and other programming. 

16 Even if certain programming is available in a local viewing area, a viewer may not be 

17 aware of its existence. This situation may be the result of a large array of available 

18 programming coupled with a limited program menu or guide. The program guide may be 

1 9 limited in that not all available programming can be listed, some programming changes occur 

20 that are not reflected in the program guide, and errors may exist in the program guide. In 

21 addition, the more comprehensive the program guide, the harder it is for the viewer to search 

22 and navigate the program guide to find a desired program. 

23 Summary 

24 The problems noted above are solved by the video and digital multimedia aggregator 

25 system and method described herein. Program content can be packaged and delivered by the 

26 system, including video, television, radio, audio, multimedia, computer software, and 

27 electronic books, or any content that can be delivered in digital format. 

28 A system for searching, packaging and delivering content using an aggregator is 

29 described. The aggregator processes requests, searches, provides search results and acquires 

30 content. 
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1 The aggregator comprises a request and results processing server, a search engine 

2 server coupled to the request and results processing server and a content acquisition server 

3 coupled to the request and results processing server. The request and results processing 

4 server receives a request for a program, the search engine server searches for the program 

5 and the content acquisition server acquires a program for delivery to the user. The request 

6 and results processing server includes a search request processor that receives information 

7 related to the user's search request and provides the information to a search results form 

8 builder that creates an electronic search request. The search request may be augmented by 

9 using a content search suggestion engine to add additional search terms and descriptions to 

10 the search request. The aggregator may also include a decoder that decodes program content 

1 1 and program metadata from remote sources for storage at the aggregator, and an encoder that 

12 encodes content metadata and programs for delivery to the user. The aggregator may also 

13 comprise one or more crawlers, such as a content crawler, to look for program content in the 

14 digital communications network. 

1 5 The search engine server searches at least a local content database. The local 

1 6 database typically comprises at least two file types, metadata and content. A content file 

17 includes a complete program content file. For example, the 1997 movie Titanic may exist in 

1 8 the local content database as a complete program content file. The complete program content 

19 file may also include a reference content or metadata that contains additional information 

20 related to the content. Such additional information in the reference content may include: a 

21 program description, including program rating, program description, video clips, program 

22 length, format (e.g., 4x3 television or 16x9 movies), and other information; billing 

23 information and digital rights management information; viewing statistics, including number 

24 of times viewed, dates/times viewed, identity of users viewing the program; advertisement 

25 information to allow ads to be inserted during viewing of the program; and other information. 

26 The additional information in the reference file may be provided in whole or in part to 

27 the system users. For example, the aggregator may provide a program description and 

28 accompanying video clips to selected systems users. The reference file may also be used by 

29 the aggregator for system administration purposes. For example, billing and digital rights 

30 management information may be used to collect appropriate fees from system users and to 

31 provide such collected fees to the entities owning rights in the content. 
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1 A remote content crawler continually crawls the digital communication network 

2 looking for content to provide to the aggregator. The content provided to the aggregator may 

3 be stored in a form of an entire content file. For example, the content may include an entire 

4 movie, television program or electronic book. Alternatively, the content provided to the 

5 aggregator may be a reference to a content file that is stored at, or that will be available at 

6 one of the remote locations. For example, the content may be a reference to a future, 

7 scheduled live sports event that will be made available to system users. The sports event 

8 may be provided for a one time fee, as part of a sports package, for which a fee is collected, 

9 or as a free event. In the examples discussed above, the content may be stored at the 

10 aggregator, and may subsequently be provided to system users. For the example of the live 

1 1 sports event, the aggregator may store the live sports event and may then provide the sports 
^ 12 event as a replay, in addition to facilitating live viewing of the sports event. 

Q 13 Description of the Drawings 

y 14 The detailed description will refer to the following drawings in which like numerals 

1! 15 refer to like elements, and in which: 

IJ 16 Figure 1 is a block diagram of primary components of a content search, packaging, 

17 and delivery system; 
rf 18 Figure 2 is a block diagram of the components of the content search, packaging, and 

3 19 delivery system configured to deliver content to a set top terminal; 

S 20 Figure 3 is a block diagram of the components of the content search, packaging, and 

SB? 

^21 delivery system configured to deliver content to a personal computer terminal; 

22 Figure 4 is a schematic of the components of the content search, packaging, and 

23 delivery system showing subsystems of an aggregator, a user terminal, and a remote content 

24 server; 

25 Figure 5 is a schematic of subsystems of a request and results processing server and 

26 components with which the processing server interacts as part of the content search, 

27 packaging, and delivery system; 

28 Figure 6 is a schematic of subsystems of a content search suggestion engine and 

29 components with which the content search suggestion engine interacts as part of the content 

30 search, packaging, and delivery system; 
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1 Figure 7 is a schematic of subsystems of a search engine server and components with 

2 which the search engine server interacts as part of the content search, packaging, and delivery 

3 system; 

4 Figure 8 is a schematic of subsystems of a content acquisition server and components 

5 with which the content acquisition server interacts as part of a content search, packaging, and 

6 delivery system; 

7 Figure 9 is a schematic of subsystems of a content delivery server and components 

8 with which the content delivery server interacts as part of the content search, packaging, and 

9 delivery system; 

10 Figure 10 is a schematic of subsystems of a system administrator and components 

1 1 with which the system administrator interacts as part of the content search, packaging, and 

12 delivery system. 

13 Figure 11 is a schematic of subsystems of a database administrator as part of the 

14 content search, packaging, and delivery system; 

15 Figure 12 is a schematic of various user input devices that may be used with the user 

16 terminal of the content search, packaging, and delivery system; 

17 Figures 13 A and 13B show a flowchart describing a process of initiating a content 

1 8 search request using the user terminal that communicates with the aggregator; 

19 Figures 14A and 14Bshow a flowchart describing processing of content search 

20 requests and search results performed within the aggregator; 

21 Figures 15A and 15B show a flowchart describing a process at the user terminal for 

22 displaying programming search results and initiating content download requests; 

23 Figures 16A and 16B show a flowchart describing processing of programming 

24 download requests by the aggregator; 

25 Figures 17A - 17C show a flowchart describing programming content delivery from 

26 the aggregator or a remote content server to the user terminal; 

27 Figures 1 8 A - 1 8C show an embodiment of a search request form; and 

28 Figures 19A - 19B show an embodiment of a search results form. 

29 DETAILED DESCRIPTION 

30 Figure 1 is a block diagram of a content search, packaging, and delivery system 200. 

3 1 The content to be packaged and delivered by the system 200 includes video, television, radio, 
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1 audio, multimedia, computer software and electronic books. Components of the system 200 

2 include an aggregator 201 and a user terminal 202, which are connected using a wide area 

3 distribution system 203. Other components are remote content servers 204 that exchange 

4 data with the aggregator 201 using a wide area network/Internet 205 connection. The user 

5 terminal 202 may incorporate a video display system 207, an audio playout system 208, an 

6 audio/video recording system 209, user input devices 214, an electronic book reader 230, and 

7 a connection to a home network 229 to interact with other devices in the user's home 

8 environment. Alternatively, one or more or all of the video display system 207, the audio 

9 playout system 208, the audio/video recording system 209, and the electronic book reader 

10 230 may be separate components that are coupled to the user terminal 202. 

11 The system 200 allows a user to enter search parameters, such as keywords and 

12 category headings, and have the aggregator 201 use these parameters to locate, package, and 

13 deliver content to the user terminal 202 from numerous sources. The requests and content 

14 deliveries can be sent over communications links including, but not limited to, telephone 

1 5 lines, coaxial cable, fiber-optic cable, wireless connections, wide area networks, the Internet, 

1 6 and other communication media collectively represented by the wide area distribution system 

17 203. The numerous sources of content are shown in Figure 4 and include, but are not limited 

18 to, an aggregator local storage 254, local streaming sources 262, remote content storage 258, 

19 and remote streaming sources 259. In an embodiment, the local streaming sources 262 are 

20 comprised of the audio and video channels being delivered using a cable headend system that 

2 1 may house the aggregator 20 1 . 

22 The system 200 will take a user's search request and may perform a search of 

23 virtually every active and scheduled radio and television channel in the world, as well as 

24 archived sources of video and audio programming such as movies and recorded audio 

25 sources and sources of other multimedia, software, and electronic book content. In an 

26 embodiment, the system 200 will also search Internet Web sites and other online databases. 

27 The user will then be able to select programming or other content for download based on the 

28 search results. In an embodiment, the download, or delivery, process can be fulfilled by 

29 making the content available on a specific channel of a cable television system, or by 

30 transmitting the content using a digital communications protocol, such as the Internet 

31 standard TCP/IP, for example. In addition, the content search, packaging, and delivery 
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1 system 200 is capable of formulating and presenting a list of suggested content based on an 

2 analysis of the user's current search parameters, stored information about previous searches 

3 and previously selected content downloads and other user-specific or related information. 

4 The system 200 is also capable of notifying a user prior to the start time of selected 

5 programming and availability of other content using such notification as an electronic mail 

6 message and/or an on-screen message indicating that the scheduled program will be 

7 broadcast at a specified time. The system 200 may support one or more digital rights 

8 management (DRM) systems to track the usage and copyrights rights associated with 

9 downloaded content and bill the user's account as appropriate and provide any license and 

10 usage fees to the content provider. The system 200 may implement a users' privacy 

1 1 protection scheme allowing users to control what information is gathered, limit what is done 

12 with that information, and review and delete the user's profile if desired. 

13 An overview of an embodiment of the system 200 is shown in Figure 2 where the 

14 user terminal 202 is a set top terminal 206 that communicates with the aggregator 201 

15 through a cable television system headend 210, thereby making use of the cable television 

16 system headend 210 high bandwidth concatenated cable system 216. Further, the set top 

17 terminal 206 system may include a tuner 228, a demultiplexer 231, the video display system 

18 207, the audio playout system 208, the audio/video recording system 209, user input devices 

19 214, an electronic book reader 230, and a connection to the user's home network 229. These 

20 components are used to tune, select, view, listen to, and store audio and video programming 

21 and other content delivered by the search, packaging, and delivery system 200. Figure 2 also 

22 shows a communications path from one or more remote content servers 204 through the wide 

23 area network/Internet 205 directly to the set top terminal 206, which bypasses the aggregator 

24 201 and cable television system headend 210. This path may be used in the case where the 

25 requested content is available in the required format from the remote content server 204 and 

26 is authorized for direct delivery to the user. In an alternative embodiment, the aggregator 

27 201 is collocated with the cable television system headend 210 that is acting as the wide area 

28 distribution system 203 as is the case when a cable television system is also serving as the 

29 user's Internet service provider. 

30 An overview of another embodiment of the system 200 is shown in Figure 3, where 

31 the user terminal 202 is a personal computer terminal 211 that communicates with the 
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1 aggregator 201 through an Internet service provider/cable television system headend 215. In 

2 this case, the content may be delivered by a cable headend that is operating as an Internet 

3 service provider (ISP). The personal computer terminal 211 also may include the video 

4 display system 207, the audio playout system 208, the audio/video recording system 209, 

5 user input devices 214, the electronic book reader 230, and the connection to the home 

6 network 229. A communications path also exists from one or more remote content servers 

7 204 through the wide area network/Internet 205 directly to the personal computer terminal 

8 211, which bypasses the aggregator 201 and the Internet service provider/cable television 

9 system headend 215 in the case where requested content is in the required format and is 

1 0 authorized for direct delivery to the user. 

11 The user can receive video and audio programs (i.e., the content) in a number of 

12 different ways. First, the tuner 228 in the user terminal 202, shown in Figure 2, can simply 

13 tune to the desired program, or the demultiplexer 231 can select a program from a digital 

14 multiplex, thereby displaying the program at the appropriate time. However, the desired 

15 program may not be broadcast by the user's cable television system headend 210, or the user 

16 would like to watch a program supplied by the local headend, but not subscribed to by the 

17 user, e.g., a boxing match broadcast by a premium channel that the user does not ordinarily 

18 receive. In these examples, the program can be delivered to the user by the aggregator 201 

19 using the telephone lines, fiber-optic transmission lines, or other communication media, or 

20 using the cable television system headend 210. In an embodiment, the aggregator 201 can 

21 supply the desired program to the user by pulling programs from program delivery systems in 

22 the United States and abroad and delivering the program to system users. Therefore, a user 

23 can have access to programs outside the user's immediate viewing area. 

24 Figure 4 shows the system 200 and system components in more detail. At a user's 

25 location, the user terminal 202 includes the tuner 228, the demultiplexer 231, a user terminal 

26 processor 227, user local storage 212 and user local database 213, Coupled to the user 

27 terminal 202 may be user input devices 214, the video display system 207, the audio playout 

28 system 208, the audio/video recording system 209, an electronic book reader 230, and a 

29 connection to the home network 229. 

30 The user terminal 202 is coupled through the wide area distribution system 203 to the 

31 aggregator 201 and further through the wide area network/Internet 205 to remote program 



8 



5311 



1 sources. The remote program sources include remote streaming sources 259 and remote 

2 central storage 258. The remote program sources also include remote databases 261 and, 

3 through the remote content server 204, a remote server database 260. 

4 The aggregator 201 may include a communications server 250 that communicates 

5 with the user terminal 202 through the wide area distribution system 203. The 

6 communications server 250 receives inputs from a request and results processing server 300, 

7 a content delivery server 450 and a system administrator 500. The content delivery server 

8 450 receives inputs from a coder and content formatter 253 and a content acquisition server 

9 400. The content delivery server 450 also accesses an aggregator local storage 254 and local 

10 streaming sources 262. Finally, the content delivery server 450 provides an output to the 

1 1 system administrator 500. 

12 The coder and coder formatter 253 receives inputs from the content acquisition server 

13 400, the aggregator local storage 254 and local streaming sources 262. The system 

14 administrator 500 receives inputs from the content and delivery server 450, and 

15 communicates with the content acquisition server 400, the request and results processing 

16 server 300, a search engine server 350 and aggregator archives 255. A decoder and content 

17 formatter 252 is coupled to the content acquisition server 400. Finally, a network gateway 

18 251 couples components of the aggregator 201 with the remote content server 204 through 

1 9 the wide area network/Internet 205 . 

20 Programs received at the aggregator 201 may be input to the formatter 253. The 

21 formatter 253 reformats all input content into a format that is readily received by all user 

22 terminals 202 operably connected to the delivery system 200 (not shown in Figure 4). In 

23 addition, the formatter 253 can store full or partial copies of content in compressed form in 

24 the aggregator local storage 254. Furthermore, the aggregator 201 can provide real-time 

25 delivery of certain content, such as a boxing match. In an embodiment, if a large number of 

26 users want a particular live program, then the cable television system headend 210 can 

27 broadcast the program on a particular channel available to all the requestors instead of 

28 broadcasting the program to each individual user over the wide area distribution system 203. 

29 See U.S. Patent Application serial number 09/191,520, entitled Digital Broadcast Program 

30 Ordering, hereby incorporated by reference, for additional details of broadcast program 

31 delivery. 
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1 The aggregator 201 can also implement a screening process for limiting the number 

2 of programs captured to those programs with a viewing audience above a predetermined 

3 threshold. In effect, the aggregator 201 contains a filter that will pass only programs meeting 

4 the predetermined selection criteria. The filter may include programming that screens the 

5 content to reject specific items, such as adult content, for example. 

6 The system administrator 500 records what fees should be paid and to whom. For 

7 example, the aggregator 201 will determine to whom any copyright or other fees should be 

8 paid when a program is broadcast. 

9 The user terminal 202 may be a television, a set top terminal 206, a personal 

10 computer terminal 21 1 (not shown), or any device capable of receiving digital or analog data, 

11 or some combination thereof. The user terminal 202 is equipped with the user input devices 

12 214 that communicate search criteria to the system 200 as well as navigate through the user 

13 terminal menu system and control the user terminal's other various functions. The user local 

14 storage 212 is used to store and archive content onto one or more removable and/or non- 
15 removable storage devices or media for later access. Removable storage media may include, 

16 but is not limited to, magnetic tape, magnetic disks, optical disks and modules, and electronic 

17 memory cartridges. The user local database 213 is the repository of all relevant information 

18 about a user's profile and account. This information includes, but is not limited to, user 

19 name, password, personal information that the user has authorized for storage, billing 

20 information, other users allowed access to the account, past search criteria, past content 

21 download information, and library information about stored content. As a consumer 

22 protection, the user terminal 202 may enable the account user to view the information stored 

23 in the user local database 213 and modify certain data fields and select which data fields may 

24 be reported to a main system database (see Figure 10) within the aggregator 201. Certain 

25 fields including, but not limited to, account numbers and billing information may not be 

26 allowed this level of user access. 

27 The user terminal processor 227 may include a central processing unit and all 

28 associated hardware, software, and firmware modules to perform all operations within the 

29 user terminal 202. These operations include, but are not limited to, managing 

30 communications with the aggregator 201 and other networked devices, processing search and 

31 download requests, displaying search and download results, managing and controlling 
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1 communications with the user local storage 212 and the user local database 213, responding 

2 to user interaction with presentation of graphical user interface (GUI) menus, playing out 

3 selected programming content using various audio and video output devices, implementing 

4 the user's part of the digital rights management schema, and administering the user's account 

5 and billing. The tuner 228 and the demultiplexer 231 are used to select an audio/video 

6 channel for play out from the channels available on the cable television system 216. 

7 In an embodiment, the user terminal 202 may incorporate selected features of the 

8 aggregator 201. For example, the user terminal 202 may include a small metadata crawler, 

9 an aggregator, and program content and program metadata storage. 

10 The user terminal 202 communicates with the aggregator 201 using the wide area 

1 1 distribution system 203. Within the aggregator 201, the communications server 250 acts as 

12 the interface point to the wide area distribution system 203 for the purpose of managing 

13 primary communications to system users. The communications server 250 routes incoming 

14 user requests and associated user information to the request and results processing server 

15 300, routes search results and content downloads through the wide area distribution system 

16 203 to end users, and routes billing information from the customer billing server 506 (see 

17 Figure 10) to the end users. The request and results processing server 300 performs the basic 

18 processing and routing related to user search requests, content download requests, 

19 administrative information requests, search results, related content suggestions, and 

20 programming notification. 

21 Figure 5 shows individual subsystems of the request and results processing server 

22 300. The types of requests from a system user include, but are not limited to, programming 

23 and other content search requests, content download requests based on results of an earlier 

24 search, and administrative information requests. Requests for administrative information 

25 may be automatically generated by the user terminal 202 or may be manually initiated by the 

26 system user. When an administrative request is received, a request receiver and router 301 

27 opens a dialog with a database administrator 502 (see Figure 10) within the system 

28 administrator 500, retrieves the requested system user's administrative data, and routes the 

29 data through the communications server 250 to the user terminal 202. Search requests and 

30 content download requests are routed to a search request processor 303 and a content 

31 download request processor 302, respectively. The processors 302 and 303 open a dialog 
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1 with the database administrator 502 and verify that the user's request is authorized. If the 

2 user's request is not authorized, the processor (302 or 303) sends a message to the user 

3 through the request receiver and router 301 and the communications server 250 informing the 

4 user that the request is denied. The processor (302 or 303) then logs the event with the 

5 system administrator 500. If the request is authorized, the processor (302 or 303) formats the 

6 request as necessary and routes content download requests to the content acquisition server 

7 400 and search requests to the search engine server 350. 

8 For programming download requests, the content acquisition server 400 submits 

9 scheduling and availability information about the selected content to the database 

10 administrator 502 within the system administrator 500, which in turn routes this scheduling 

1 1 and availability information to a scheduled program and content availability prompt and 
** 12 notification processor 306 within the request and results processing server 300. The 
8 13 scheduled program and content availability prompt and notification processor 306 then 
y 14 initiates a form of prompt and/or notification to the user that the selected content is available 
i 1 5 at a particular time. This notification can be in various forms including, but not limited to, an 
U 16 on-screen pop-up window, audible notification, e-mail notification, instant message, and 

17 automated telephone notification. The exact form and timing of the prompt and/or 

J 1 8 notification may be customized by the user and may be based on whether the content is 

3 19 scheduled, continuously broadcast, stored, or available any time for download. In an 

3 20 embodiment, when a selected program is about to be broadcast or made available for viewing 

"21 on television, a prompt will be sent by the server 300 notifying the user when the program is 

22 about to air. In the case of an on-screen prompt, a mechanism may be provided for enabling 

23 the user to hyperlink to the selected program from the prompt. For search requests, the 

24 search engine server 350 returns a data package to the request and results processing server 

25 300 that contains scheduling, availability, and descriptive information about all content 

26 entries that have been determined to satisfy the search criteria. 

27 In addition to searching for content containing criteria entered by a system user, a 

28 content search suggestion engine 304, in conjunction with the search engine server 350 will 

29 be able to suggest content to the user that is related in various ways, such as by category or 

30 theme. The content search suggestion engine 304 is shown in detail in Figure 6. For 

3 1 example, if a user wishes to see programs about Titanic, the content search suggestion engine 
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1 304 may, in addition to suggesting programs about Titanic, suggest or inform the user of 

2 programs and other content such as electronic books about ships other than Titanic. 

3 Likewise, if the search criteria include Johnny Weismuller, an actor who starred in Tarzan 

4 movies, the content search suggestion engine 304 might suggest programs and other content 

5 about Tarzan featuring someone other than Johnny Weismuller. Furthermore, the content 

6 search suggestion engine 304 may suggest programs for viewing based on past search criteria 

7 entered by the user as well as information on content the user has actually downloaded. For 

8 example, if the search criteria includes Johnny Weismuller and the user has searched and/or 

9 downloaded numerous sports-related programming in the past, the content search suggestion 

10 engine 304 may suggest programming and other content including swimming competitions 

1 1 and sports history and biography programming as well as Tarzan movies and other content 

12 directly related to Johnny Weismuller such as the Jungle Patrol television series. If the user 

13 searched for and received Tarzan movies, the content search suggestion engine 304 might 

14 suggest electronic books by Edgar Rice Burroughs. Such electronic books could then be 

1 5 downloaded to the user terminal 202 using the wide area network/Intranet 205 bypassing the 

16 aggregator 201, or could be compiled at the aggregator 201 for delivery to the user terminal 

17 202. Electronic book delivery systems are described in U.S. Patent 5,986,690, entitled 

18 "Electronic Book Selection and Delivery System," to Hendricks, and in co-pending patent 

19 application serial numbers 09/289,957, entitled "Electronic Book Alternative Delivery 

20 Systems," and 09/289,956, entitled "Electronic Book Alternative Delivery Methods," all of 

21 which are hereby incorporated by reference. 

22 During submission of a content search request, the user may have the option of 

23 disabling the return of suggested content results if desired. In order to retrieve results for 

24 suggested programming, the content search suggestion engine 304 analyzes a search request 

25 form 618 (see Figures 18A - 18C) received from the user terminal 202, and performs a 

26 search within a suggestion database 308 for additional search criteria to be used to find 

27 suggested content related in some way to the original search request results. These suggested 

28 search criteria are appended to the search request form 618 forming an augmented search 

29 request form 620 (Figures 18A - 18C) when the search request form 618 is forwarded to the 

30 search engine server 350 in order for a suggested content list to be returned. U.S. Patent No. 

31 5,798,785 entitled "Terminal for Suggesting Programs Offered on a Television Program 
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1 Delivery System and co-pending patent application Serial Number 08/906,469, filed 

2 August 5, 1997, entitled "Reprogrammable Terminal for Suggesting Programs Offered on a 

3 Television Program Delivery System," both of which are hereby incorporated by reference, 

4 provide additional details on program suggestion. 

5 The suggestion database processor 307 (shown in Figure 6) conducts a search of the 

6 suggestion database 308 to find related search criteria to use to locate suggested content. The 

7 processor 307 also performs management functions for the other subsystems of the content 

8 search suggestion engine 304. When prompted by the suggestion database processor 307, the 

9 content metadata crawler 309 crawls, or intensively searches, the metadata in the aggregator 

10 local database 501 and passes a listing of all content metadata to the suggestion keyword 

11 indexer 310, which indexes each metadata element and assigns each with a vector quantity 
*i 12 that describes the metadata element as a suggestion keyword associated with a particular 

2 13 content entity. The indexer 310 then populates the suggestion database 308 with these 
ij 14 indexed suggestion keywords, which are used by the suggestion database processor 307 
H 15 along with historical data relevant to the user to supply a list of suggested search terms. The 
"4 16 search terms are then added to the search request form 618 to create an augmented search 

17 request form that is returned to the search request processor 303 (see Figure 5). 

£ 18 The search engine server 350, shown in Figure 7, receives the augmented search 

U 

3 19 request form 620 and performs a search of the database of all known programming content, 
3 20 both local and remote, and builds a hierarchical list of results based on how well each result 
w 21 compared to the search criteria. The search engine server 350 contains a replicated content 

22 database 357 to be able to perform searches more efficiently and maintains a list of active 

23 searches to which new content listings are compared. Periodically, the search engine server 

24 350 thoroughly searches, or crawls using a remote content crawler 356, all available sources 

25 of programming and other content, retrieves all information about all content not previously 

26 logged into the system and enters that data into the aggregator local database 501 (see Figure 

27 4). In an embodiment, the search engine server 350 may directly access remotely stored 

28 content and analyze and retrieve metadata from the stored digital files. 

29 In an embodiment, the aggregator local database 501 and the search engine server 350 

30 reside on an array of distributed processing and storage devices in order to reduce database 

31 access time and perform searches in parallel on different sections of the database. In another 
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1 embodiment, numerous aggregators 201 can be operated by various stakeholders such as 

2 cable television headend operators. These aggregators 201 will be capable of networking 

3 directly together using the wide area network/Internet 205. Within this network of 

4 aggregators 201, business models will support various relationships between operators such 

5 as a peer-to-peer network of content, advertising, and user sharing. The aggregator 201 

6 software and hardware components may be of a modular nature in order to support various 

7 system architectures as well as be scalable and easily upgraded on a module or subsystem 

8 basis. 

9 Returning to Figure 5, all search results, based on user search criteria and suggested 

10 search criteria, may be forwarded by the search engine server 350 and then to the search 

11 results form builder 305 within the request and results processing server 300. The search 
m 12 results form builder 305 formats the results for transmission through the communications 
^9 13 server 250 to the user terminal 202. The search results form builder 305 takes prioritized 
fy 14 lists of user search results and suggested search results and populates a search results form 
1(1 15 674 (see Figures 19A and B) with programming, scheduling and availability information, 
til 16 The request and results processing server 300 then encrypts and forwards the search results 
7 17 form 674 through the communications server 250 to the user terminal 202. At the user 
j : rf 1 8 terminal 202, the search results form 674 is decrypted and stored in the user local database 
13 19 213 and a prompt is displayed that allows the user to display the returned results on the video 
}Sj 20 display system 207 or the electronic book reader 230. 

21 The search results can then be displayed on the user's video display system 207 in 

22 various formats including, but not limited to, a hierarchical listing based on relevance to 

23 search criteria and a display similar to an electronic program guide based on time of 

24 availability and content source. The user will be able to select from the various results 

25 display formats and have the results data be reformatted upon request. In an embodiment, 

26 the user may be able to select one of the search criteria or an attribute of the programming 

27 and the results will be sorted based on that selection. For example, if numerous program 

28 types are returned, the user can select "documentaries" and the results will be listed with 

29 documentary programs occurring first. The results display will also indicate whether a 

30 particular programming choice is a result of the user-defined search criteria or was a result of 

31 the system's capability to suggest content. The user will have the ability to display only 
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1 results from the user search, only results from the suggested content search, or both. In an 

2 embodiment, the entire menu system can be implemented using audible prompts and lists in 

3 order to accommodate users with visual impairments. In such a scenario, input methods can 

4 be by voice recognition, tactile recognition such as a remote control equipped with a Braille 

5 character input pad, or a combination of these methods. 

6 As shown in Figure 4, the network gateway 251 serves as the communications system 

7 between the aggregator 201 and the wide area network/Internet 205, and hence the remote 

8 content server 204. The network gateway 251 may support any protocol in widespread use 

9 for connection to the wide area network/Internet 205 and will serve as a security firewall 

10 between the aggregator 201 and the wide area network/Internet 205. The network gateway 

11 251 will route search and content download information from the aggregator 201 to the 

12 remote content server 204 and route search results and content from the remote content 

1 3 server 204 and other Internet sources back to the aggregator 20 1 . 

14 The content acquisition server 400, as shown in detail in Figure 8, receives content 

15 download requests from the request and results processing server 300. The content 

16 acquisition server 400 includes a content request processor and router 401 and a remote 

17 content download processor 402. A download request is made by the user for content 

1 8 selections from sources including, but not limited to, earlier programming searches, recurring 

19 scheduled events, an electronic program guide, lists of electronic books and computer 

20 software, advertisements, promotions, and affiliated Internet websites. In general, a 

21 download request will be accompanied by data indicating the source of the content and 

22 whether the content is local or remote. Requests for content that is available only from a 

23 remote site may be routed to the network gateway 251 and then to the appropriate remote 

24 source. Remote sources include, but are not limited to, the remote content storage 258 and 

25 the remote streaming sources 259 shown in Figure 4. The remote content server 204 verifies 

26 the request and returns the content through the wide area network/Internet 205. If the 

27 programming content is in the appropriate format and is authorized for direct delivery to the 

28 user, the content may be routed through the wide area network/Internet 205 and the wide area 

29 distribution system 203 directly to the user terminal 202. During this transfer, administrative 

30 data pertaining to billing and verification of delivery are sent back to the aggregator 201 . 
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1 Programming that is not formatted and authorized for direct delivery from a remote 

2 source may be transmitted through the network gateway 251 to the remote content download 

3 processor 402 contained within the content acquisition server 400. The remote content 

4 download processor 402 buffers or caches the programming content while managing the 

5 download connection to the remote source. The programming content is then routed to the 

6 decoder and content formatter 252, which may be capable of decoding various industry 

7 formats and compression schemes and may reformat and encode the decoded data and 

8 associated metadata into one or more preferred content formats for delivery and for local 

9 storage. The processed programming content, along with user identification and routing 

10 data, is then routed to the content delivery server 450, which then manages the delivery of the 

1 1 content through the communications server 250 and wide area distribution system 203 to the 

12 user terminal 202. The content delivery server 450 is shown in detail in Figure 9. 

13 Requests for programming available from a local source are routed directly to a local 

14 content request processor 451 within the content delivery server 450. The local content 

15 request processor 451 initiates delivery of content from local sources including, but not 

16 limited to, the aggregator local storage 254 and aggregator local streaming sources 262, and 

17 routes the content to the coder and content formatter 253. In an embodiment, the local 

18 streaming sources 262 can include any of the cable television channels available at the cable 

19 television system headend 210 housing the aggregator 201. If the programming content is 

20 not already in the user-requested format and coding scheme, the coder and content formatter 

21 253 (see Figure 4) performs content formatting and coding of the programming for delivery 

22 to the user. The content is then forwarded to a content delivery processor 453, which 

23 manages the delivery of the content through the communications server 250 and wide area 

24 distribution system 203 to the user terminal 202. 

25 During the content acquisition and delivery process, the content delivery processor 

26 453 oversees and validates that the delivered programming content matches the original 

27 content download request. This is done by receiving program and user metadata from the 

28 content acquisition server 400 through the local content request processor 451 and comparing 

29 the received data to the metadata of the actual requested content and the actual delivered 

30 content as received during the program request and download process. A confirmation is 

3 1 then logged with the system administrator 500. In an embodiment, based on user information 
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1 and content metadata, the content delivery processor 453 can command an advertisement 

2 processor 456 to insert specific advertising into certain programming content as it is 

3 delivered to a system user. The advertising can be retrieved from the aggregator local 

4 storage 254 or can already be resident at the user terminal 202. Methods for targeting 

5 advertisements to users are described in co-pending patent applications Serial No. 

6 09/054 ? 419 5 entitled "Targeted Advertising Using Television Delivery Systems " and Serial 

7 No. 08/160,280, entitled "Method and Apparatus for Targeted Advertising," both of which 

8 are hereby incorporated by reference. Confirmation of the programming delivery is also sent 

9 to the database administrator 502 for logging into the aggregator local database 501 . 

10 Similarly, if content is copyright protected and the user is granted certain rights and 

1 1 denied others for use of copyright protected content, the content delivery processor 453 can 

12 command a digital rights management processor 454 to implement a digital rights 

13 management (DRM) scheme. The DRM scheme controls how digital content is used, 

14 including, but not limited to, whether or not the content can be stored on the user terminal 

1 5 202, copied to another system, forwarded to another user, transferred to removable media, or 

16 translated into a different digital content format or coding scheme. The DRM scheme may 

17 be able to make use of digital encryption technology to enforce copyright protection if 

1 8 necessary. When this is the case, the digital rights management processor 454 will command 

19 the content delivery processor 453 to route the subject programming content along with 

20 encryption data to an encryption processor 455. The encryption processor 455 encrypts the 

21 programming content and returns the content to the content delivery processor 453 for 

22 transmission to the end user. Under this type of scenario, the authorized user terminal 202 

23 will possess the necessary information to decrypt and output the programming content. The 

24 user terminal 202 will also contain the necessary information to enforce any DRM scheme 

25 that has been applied to a particular piece of content. 

26 During the delivery of programming content other than broadcast programming over 

27 the concatenated cable television system 216, the user terminal 202 continuously responds to 

28 the content delivery processor 453 identifying the user terminal 202, verifying that the 

29 appropriate data is being delivered, and indicating that the delivery should continue. If the 

30 download is terminated by the user, the user terminal 202 informs the content delivery 

3 1 processor 453, which then terminates the delivery. 
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1 Upon successful delivery of the requested programming, the content delivery server 

2 450 logs the results with a customer billing server 506 and content fee and copyright billing 

3 server 507 within the system administrator 500 (see Figure 10). The customer billing server 

4 506 determines if the content delivery requires additional charges to the customer's account 

5 and enters this into the billing record and logs it with a database administrator 502. 

6 In addition to tracking billing for system end-users, the content search, packaging, 

7 and delivery system 200 also manages payments of royalties and fees to providers of certain 

8 content. This is done by the content fee and copyright billing server 507. The fee structure 

9 for payment for content to program providers is put into place between the system 200 and 

1 0 the programming content providers by a content provider registration server 505 . 

11 The system administrator 500 oversees the operations of the content search, 

12 packaging, and delivery system 200. A system administration server 503 serves as the top- 

13 level management function for the system 200. The system administration server 503 

14 manages communications between the various subsystems of the aggregator 201 through a 

15 local area network and manages a list of authorized administration users to manage the 

16 system 200 through a set of system administration terminals 508. A user registration server 

17 504 manages the signup procedure for new users and the termination of user accounts. The 

1 8 user registration server 504 interfaces with the communications server 250 to present the user 

19 with appropriate screen menus and prompts to gather user information and billing data to 

20 setup an account. A variety of information is requested of the user including, but not limited 

21 to, name, address, age, gender, television viewing habits, members of household, and 

22 equipment owned. Some of the information that is not required for billing, such as gender 

23 and other members of household, can be omitted by the user as part of the system's policy of 

24 privacy protection. Once billing information has been verified, the user registration server 

25 504 downloads the required software and database information for the new user terminal 202 

26 in order to allow access to the content search, packaging, and delivery system 200. During 

27 this process, the user registration server 504 exchanges information with the database 

28 administrator 502 to create the new user profile and billing account in an aggregator local 

29 database 501. 

30 A database administrator 502, shown in detail in Figure 11, maintains the aggregator 

31 local database 501 and interfaces with the various components of the aggregator 201 that 
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1 retrieve information from and store information to the aggregator local database 501. The 

2 database administrator 502 controls several database servers. A group of individual 

3 databases maintained within the database administrator 502 constitutes the aggregator local 

4 database 501. An administrative database server 509 maintains an aggregator administrative 

5 database 510, which stores and processes information including, but not limited to, 

6 authorized system administrators, passwords, and administrator usage rights. The 

7 administrative database server 509 also governs replication of all databases to aggregator 

8 local storage 254 and backup of aggregator local storage 254 to the aggregator archives 255. 

9 A user database server 511 maintains an aggregator user database 512, which stores and 

10 processes information including, but not limited to, user account data, user profile 

1 1 information, user subscription services, user access rights, and past user search and download 

12 data (if authorized by the user). 

13 A content provider database server 513 maintains a content provider database 514, 

14 which stores and processes information including, but not limited to, a roster of registered 

15 content providers and their administrative data, remote provider administrators and their 

1 6 passwords and access rights, and terms of agreements between providers and the operator of 

17 the particular aggregator 201. A content database server 515 maintains an aggregator local 

18 content database 516, an aggregator remote content database 517, and an aggregator 

19 scheduled content database 518. The aggregator local content database 516 stores and 

20 processes information including, but not limited to, the catalog of all content stored in the 

21 aggregator local storage 254 and all metadata associated with that content. The aggregator 

22 remote content database 517 stores and processes information including, but not limited to, 

23 the catalog of all content stored in each remote database 261 and all metadata associated with 

24 that content. The aggregator scheduled content database 518 stores and processes 

25 information including, but not limited to, scheduled broadcast programming content and 

26 scheduled streaming program content available to users, available live programming, 

27 recurring scheduled programming, and program schedule metadata information. 

28 The system user can initiate content search requests by entering several different 

29 types of search criteria using several different options of input device or method. Search 

30 criteria can be entered via keywords that relate to certain aspects of programming content 

31 including, but not limited to, subject, author, title, cast members or performers, director, 
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1 and/or content description. A search can be based on program type or format including, but 

2 not limited to, movies, television series, documentaries, sports programs, talk radio, and 

3 music radio. The user may input search criteria based on subject categories including, but 

4 not limited to, action, drama, history, educational, juvenile, adult, current events, nature, live 

5 events, and music categories such as classical, jazz, rock, consumer affairs, political content, 

6 and geographically specific content. Search criteria can also be entered based on time of day, 

7 channel, and/or content provider. The user may also input free form questions using plain 

8 speech patterns. In any case, the different search criteria can be used separately or in 

9 conjunction with one another to refine a content search. An example might be the entry of 

10 "Titanic" as a keyword, "Documentary" for program type, and the free form question "What 

1 1 company built Titanic? 99 . 

12 The user can interact with the user terminal 202 to input search parameters using one 

13 or more of several user input devices 214 including, but not limited to, those shown in Figure 

14 12. The user input device 214 includes a keyboard 220, a keypad 221, a mouse or joystick 

15 222, a handheld computer 223, a touch screen tablet 224, a handheld remote control 225, a 

16 user terminal voice recognition system 219, an input device voice recognition system 226, 

17 and an electronic book reader 230. 

18 In an embodiment, keywords and free form question criteria can be entered with the 

19 keyboard 220 attached to the set top terminal 206 or the personal computer terminal 21 1 and 

20 content type and category criteria can be selected using the mouse or joystick 222, which 

21 controls a cursor on the screen. In another embodiment, text for keywords and free form 

22 questions can be entered using the keypad 221, which can be located on the set top terminal 

23 206, in the handheld remote control 225, or in a dedicated wireless unit (not shown). The 

24 handheld remote control 225 may also incorporate a pointing control device or button to 

25 move a cursor on the screen and activate selections under said cursor and to navigate through 

26 a series of graphical user menus. In another embodiment, the handheld computer 223, 

27 electronic book reader 230, or the touchscreen tablet 224 can contain software programming 

28 enabling an input device to the user terminal 202 using an infrared or wireless link and 

29 allowing text input and on screen cursor and menu control. The handheld computer 223 

30 refers to devices including, but not limited to, personal digital assistants, palm top computers, 

31 and multifunction devices such as wireless telephones and mobile Internet access devices 
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1 capable of operating third party software. In yet another embodiment, voice recognition 

2 technology can be used to input text and to control onscreen navigation and selection 

3 functions. Voice recognition can be implemented by receiving and processing speech at the 

4 user terminal 202 through the user terminal voice recognition system 219. In another 

5 embodiment, voice recognition can be implemented by receiving speech by a remote input 

6 device using the input device voice recognition system 226. The input device would then 

7 convert the received speech to text and onscreen control commands and send those to the 

8 user terminal 202 using the infrared or wireless link. 

9 In order for the user terminal 202 to communicate with the various remote input 

10 devices, the user terminal 202 may be equipped with an infrared wireless transceiver 217 

11 and/or a radio frequency wireless transceiver 218. These systems will support various 

12 popular industry standards in use for device communication via infrared and radio frequency 

13 wireless links. 

14 The user can also input search criteria by making selections from a graphical user 

15 interface (GUI). In an embodiment, the user terminal 202 generates a content search GUI 

16 containing menus that allow the user to select and enter various search criteria. The user can 

17 select a criterion to be searched by delineating areas of a GUI. For example, the user can 

1 8 select a criterion to be searched by putting a check in a box associated with the criterion or by 

1 9 placing the cursor over a hyperlinked criterion description and hitting an activation button 

20 that then causes a submenu GUI to be displayed that shows selections to be made within that 

21 search criterion. (See Serial Number 07/991,074, filed December 9, 1992, entitled 

22 "Television Program Packaging and Delivery System with Menu Driven Subscriber Access", 

23 hereby incorporated by reference, for additional detail on using cursor keys.) For example, 

24 the user might select from programs based on general themes including, but not limited to, 

25 categories of programs, actors and actresses, musical performers, day and time, and channel 

26 or content provider. If the viewer then selects categories of programs, a submenu containing 

27 different categories of programs such as sports, drama, comedy and romance will appear. If 

28 the user then selects sports, another lower level submenu will appear listing different sports. 

29 Each of the menus will include a choice to enter keywords or free form text in addition to the 

30 menu- selected search criteria. Once the user has sufficiently narrowed the search criteria, the 

3 1 search can be executed by selecting an option to submit the search. For privacy protection, 
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1 during this process, an option on the GUI menus allows the user to prevent the set of search 

2 criteria from being included in a local user profile as well as the user profile resident at the 

3 aggregator 201 . If the user opts not to include a particular set of search criteria into the user 

4 profile, the search request will be tagged accordingly as it is processed through the system 

5 and when results are returned to the user, those results will also be omitted from the user 

6 profile, both locally and at the aggregator 201 . 

7 A process 600 for initiating a programming search request 600 is shown in Figures 

8 13A and 13B. The process 600 starts when the user activates the search menu (routine 601) 

9 using one of the input devices 214 described above. In display routine 602, the user terminal 

10 202 displays the top-level graphical user interface (GUI) search menu 603. In input routine 

1 1 604, the user employs the user input devices 214 to navigate through the GUI search menu 

12 system and input various search criteria. During the search criteria input process, the user is 

13 also presented with the option to omit a particular search from being logged into the user's 

14 profile and the option to disable the return of suggested content based on the current search 

15 and prior searches recorded in the user's profile. When the user submits the search request, 

16 format routine 605 begins processing the search criteria in order to format the search criteria 

1 7 into a search request form 618. 

18 The search request form 618 shown generally in Figures 13 A and 13B and in more 

19 detail in Figures 18A - 18C is an electronic form standardized within the content search, 

20 packaging, and delivery system 200. The search request form 618 is populated with required 

21 user information and search criteria in order for the aggregator 201 to perform the search for 

22 relevant content. The search request form 618 contains data fields including, but not limited 

23 to: user identification, user authorization, password, digital rights management (DRM) 

24 information, user's encryption key if applicable, content format requirements, updates to the 

25 user's profile (if enabled by user), user network routing information, and the programming 

26 search criteria. The search criteria section of the search request form 618 will contain several 

27 hierarchical lists of criteria to accommodate the various types of search criteria that can be 

28 entered by the user. Search criteria entries include, but are not limited to, program type, 

29 content format, topic or subject, content description, date and time range, channel or content 

30 provider, and a list of keywords received from user input, and results derived from free form 

31 questions. 
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1 If criteria are input as a free form question, routine 605 applies a search criteria 

2 algorithm to parse the question and transform the question into relevant search request form 

3 618 contents. The sentence structure is analyzed and, based on order and relative positions 

4 of the words within natural language sentence structure, significant terms are categorized and 

5 entered into appropriate fields of the search request form 618. In an embodiment, the search 

6 request processor 303 (see Figure 5) will access a lexicon of all known English language 

7 words, terms, and names in order to augment the search request form 618 with various forms 

8 of words found in free form questions. For example, if the question is "Who assassinated 

9 Abraham Lincoln?" the search request processor 303 will access the lexicon and return other 

10 forms of the word "assassinated" such as "assassinate", "assassin", and "assassination". In 

1 1 another embodiment, other similar words will be added to the search criteria such as "kill" 

12 and "murder". The search request processing algorithm can also designate additional search 

13 parameters based on the type of query words used in the free form entry. For example, a 

14 question such as "Where does the largest land mammal live?" will cause the search process 

15 to prioritize results containing geographical information within the content metadata and 

16 description. 

17 Once the search request form 618 has been formatted, routine 605 logs the search 

1 8 criteria into the user local database 213 associated with that particular user (if the search has 

19 not been selected for omission from the database). The search criteria may be kept as a part 

20 of the user's profile for suggesting content and for personalizing searches and advertising. 

21 The routine 605 then forwards the search request form 618 and matching routine 606 uses the 

22 search criteria within the search request form 618 to search the user local database 213 for 

23 matching or similar content that is stored in the user local storage 212. If no matching or 

24 similar content is found locally, the routine 606 routes the search request form 618 to routine 

25 613. If the search yields matching or similar content that is available locally, the routine 606 

26 routes the search request form 618 to routine 607, which formats the results of the local 

27 database search into a local results form, which is then presented on the video display system 

28 207 by display results routine 608. Concurrently, the routine 607 forwards the search request 

29 form 618 to the routine 613, which opens communications with the communications server 

30 250 at the aggregator 201, encrypts the search request form 618, and forwards an encrypted 

31 search request form 619 to the request and results processing server 300, which initiates 
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1 processing of the search request represented by processing routine 650 as shown in Figure 

2 14A. 

3 Once the encrypted search request form 619 has been sent to the aggregator 201, 

4 polling routine 614 initiates a periodic poll of the results inbox at the user terminal 202. 

5 When results are returned by the aggregator 201 in the form of a search results form 674 (see 

6 Figures 19A and B for a detailed structure of the search results form 674), the search results 

7 form 674 is delivered to the results inbox and a subsequent poll will initiate the display of the 

8 results to the user. After the periodic poll is started, the user terminal 202 prompts the user to 

9 perform another search (routine 615). If the user responds "yes," the routine 615 routes the 

10 process flow back to the display routine 602, which again displays the search GUI menus 

1 1 603. If the user chooses not to perform another search, processing moves to the routine 616, 

12 which resumes playout or display of programming that was in process when the search was 

13 first initiated. Execution of routine 617 results in a display of a small icon or window in a 

14 small portion of the video display indicating that the search is in progress. This icon is 

15 referred to as the "Performing Search" bug. If the local search found content and displayed 

16 the local search results to the user, the user inputs a selection using routine 609. If the user 

17 chooses not to view any of the local results, routine 610 routes processing to the routine 616. 

18 If the user chooses to playback programming from the local results, the chosen selection is 

19 retrieved by retrieval routine 611 from user local storage 212 and played back by playout 

20 routine 612 through the video display system 207 and/or the audio playout system 208. The 

21 routine 612 also displays the Performing Search bug on the display screen. The Performing 

22 Search bug may have an option to hide the icon, therefore removing the icon from the 

23 display. 

24 Figures 14A and 14B show a flowchart for processing programming search requests 

25 and results 650. In a first stage, the encrypted search request form 619 is received from the 

26 programming search request initiation process 600, decrypted, and routed to the request and 

27 results processing server 300 (routine 651). Log routine 652 performs a call to the 

28 aggregator local database 501 to log the current request into the user's profile. If the user has 

29 indicated that the current search shall not be included into the user's profile, only 

30 administrative data pertaining to the search are recorded. Recorded information includes, but 

3 1 is not limited to, updates to the user profile (if enabled), changes to the user terminal 202 
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1 architecture, additional user identities, deleted user identities, and increments to the search 

2 counter for tracking and billing. Routine 653 also performs a call on the database to retrieve 

3 user identification and profile information. Routine 654 uses the user data in the search 

4 request form 618 and the information retrieved from the aggregator local database 501 to 

5 verify that the user is authorized to perform the particular search. A search can be designated 

6 as unauthorized under certain conditions including, but not limited to, if the user searches for 

7 specifically tiered channels that the user's account cannot access such as premium pay 

8 movies, if adult material or channels are designated in the search and the user is identified as 

9 being restricted from such access, or if the user's billing status is not in good standing but the 

10 account has not yet been terminated. If the search is deemed unauthorized, routine 655 

1 1 notifies the user terminal 202 that the search request has been denied. The user terminal 202 

12 displays the search request denial message along with any other relevant data such as the 
Hi 13 reason for denial. The process 650 then stops (routine 656). 

ly 14 If the user is authorized for the particular search, the search request form 618 is 

H 15 forwarded. In an embodiment, filter routine 657 filters the request based on the user's 

HJ 16 profile. In another embodiment, this filtering occurs within the user terminal 202 prior to the 

17 search request form 618 being sent to the aggregator 201. The filtering process narrows the 

;i 18 range of sources that will be searched by eliminating types of content or content providers 

13 19 based on the user's preferences. For example, the user may designate that no children's 

15 20 programming or sources be returned in the search results. In this case, the routine 657 

H 21 appends the search request form 618 to indicate that such programming and sources should 

22 not be included in the programming search. This not only allows the user to more finely 

23 tailor the search, but also allows the aggregator 201 to perform quicker and more efficient 

24 searches by reducing the range of sources and records that will be searched. 

25 The routine 657 then routes the search request form 618 to the content search 

26 suggestion engine 304 (see Figure 6), which uses the information in the search criteria and 

27 user profile to create a list of suggested search criteria. In an embodiment, the content search 

28 suggestion engine 304, maintains an indexed database of suggestion keywords in the 

29 suggestion database 308. The relevance of a given search keyword, which is obtained from 

30 the user's search request form 618, to a suggestion keyword is determined in vector 

31 difference routine 658 by calculating a vector quantity difference between the search 
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1 keyword and indexed suggestion keywords. The vector quantity may be a measure of 

2 similarity between two words that is calculated by determining relative values of several 

3 categorical descriptions of each word including word type, part of speech of each word, and 

4 relative locations or linkage in a thesaurus. Suggestion keywords that fall within a 

5 predetermined range of relevance, i.e., that have vector quantities below a certain limit, are 

6 collected in execution of the routine 658 by the suggestion database processor 307. The 

7 routine 659 then weights, or ranks, the list of suggestion keywords based on information 

8 retrieved from the user's profile concerning earlier search and download requests. The 

9 suggestion database processor 307 then adds these suggested search criteria to the search 

10 request form 618 in routine 660, creating an augmented search request form, which is 

1 1 forwarded to the search engine server 350 by (routine 661). 

12 To create and maintain the indexed suggestion database 308, the content metadata 

13 crawler 309 periodically crawls the content metadata entries of all listed content and 

14 programming in the aggregator local database 501 and retrieves all descriptive data for each 

1 5 entry. Crawling is a thorough scan and retrieval of all data pertaining to each content item 

16 that is listed in the content database server 515, which includes information about all 

17 registered content and information about programming that has been retrieved by crawling 

18 sources of content. The suggestion keyword indexer 310 then associates a unique numerical 

19 value to each term and enters this into the suggestion database 308 as indexed suggestion 

20 keywords. The index indicates the proximity of terms to one another within the metadata. 

21 This proximity within the metadata is then used by the suggestion database processor 307 to 

22 determine the vector relevance of suggestion keywords to search keywords and select a range 

23 of suggestion keywords to add to the search request form 618. See The Anatomy of a Large- 

24 Scale Hypertextual Web Search Engine, Sergey Brin and Lawrence Page; Computer Science 

25 Department, Stanford University, Stanford, CA 94305, USA, hereby incorporated by 

26 reference, for more detail about crawling of websites, indexing terms, and ranking of search 

27 results. 

28 Using the example of Johnny Weismuller, the content metadata crawler 309 crawls 

29 the database and returns numerous descriptions of Tarzan movies and other content and 

30 collects data including, but not limited to, co-stars, directors, settings, authors, and plot lines 

31 or subjects. The suggestion keyword indexer 310 indexes Johnny Weismuller and all other 
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1 information found and assigns a vector relevance based on type of information and 

2 proximity. Then other significant terms, such as Africa as the story setting, are then crawled 

3 and the process is repeated to populate the suggestion engine database. When a user searches 

4 for Johnny Weismuller, the suggestion database processor 307 returns an augmented search 

5 request form that contains suggested search criteria that will return related results such as 

6 other movies produced during that time period set in Africa, other movies based on stories by 

7 Edgar Rice Burroughs, novels by Edgar Rice Burroughs, and other movies with similar plot 

8 lines such as a child being isolated in the wilderness left to fend for itself while growing up. 

9 Search results returned based on suggested search criteria are labeled as such as they are 

1 0 processed by the search engine server 350. 

1 1 In an embodiment, the search request processor 303 maintains a lexicon of all known 

12 English language words, terms, and names and will augment the search request form 618 

13 with variations of words listed as keywords. For example, if the search request form 618 

14 contains "sink" and "Titanic" other forms of the word "sink" will be added to the search 

1 5 criteria such as "sunk" and "sinking" while ignoring the alternate definition of "water basin." 

16 In yet another embodiment, the search request processor 303 also maintains lexicons for 

1 7 chosen non-English languages and will have the capability to perform language translation of 

1 8 search criteria for augmentation of the search request form 618. 

19 T ^ search engine server 350, as shown in Figure 7, contains the subsystems 

20 necessary to perform searches of all available content, process the search results, and crawl 

21 remote content sources. A search is initiated when the request and results processing server 

22 300 forwards an augmented search request form to the search engine processor 351 

23 represented by routine 661 in Figure 14A. In routine 662, the search engine processor 351 

24 uses the criteria within the augmented search request form to perform a search for matching 

25 data within the replicated content database 357. The replicated content database 357 is a 

26 copy of the contents of the content database server 515 within the system administrator 500. 

27 The replicated content database 357 is periodically updated by the system administrator 500 

28 and is maintained within the search engine processor 351 to allow quicker and more efficient 

29 return of search results. The search engine processor 351 uses retrieval routine 663 to 

30 retrieve a programming list for which any of the search criteria appeared in the content 

31 metadata. The programming list is forwarded to the search results processor 355, which, in 
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1 routine 664, compares the relevancy of each returned result to the search criteria and ranks 

2 the results based on strength of the match using information including, but not limited to, key 

3 words, subject, content type, content category, author, and cast members. Relevancy and 

4 strength of match are determined by the number and type of matching criteria as well as the 

5 user's profile data such as preferred content providers and past download requests. If the 

6 user is searching for movies about Titanic, then movies with "Titanic" in the description will 

7 be ranked higher than documentaries about Titanic, In an embodiment, the search results 

8 processor 355 will also take into account such information as how many other users have 

9 downloaded the program and whether the program has received positive critical reviews and 

10 will improve the ranking of more popular and well reviewed programs. Therefore, for a 

11 search of content type "movie" and keyword "Titanic" the search engine server 350 would 
„ 12 return the 1997 Academy Award winning movie Titanic as the top ranked content match. 

D 13 The second ranked result would likely be the audio soundtrack from the same film. 

o 

r* 14 The search engine server 350 also crawls remote content sources in order to maintain 

■*J 15 an up-to-date listing of content available from independent providers that are not registered 

U 16 with the content search, packaging, and delivery system 200. The crawling is done by 

^17 periodically searching sources of content using the wide area network/Internet 205 and 

3 18 returning available metadata about content that is not already listed in the aggregator local 

3 19 database 501 and adding these listings to the database 501. Subsequent replication of the 

J? 20 content database to the search engine server 350 will include these updated listings. 

& 21 Another function performed by the search engine processor 351 is maintaining a list 

22 of active searches. If a user's search request did not yield satisfactory results, or if the user 

23 wishes to receive future results based on a particular set of search criteria, the user can 

24 request that a particular search request remain active for a certain period or indefinitely. 

25 When this option is exercised, the user terminal 202 sends a message to the request and 

26 results processing server 300, which instructs the search engine processor 351 to keep the 

27 search active. When there are changes to the replicated content database 357, a delta report 

28 that describes content entries that have been changed and/or added to the database is sent to 

29 the search engine processor 351. The search engine processor 351 compares the data in the 

30 delta report to all active searches and generates a results list for any active search that 
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1 matches new or changed content entries. The results are then forwarded to the request and 

2 results processing server 300 for routing to the respective system user. 

3 Once the search engine processor 351 has ranked the search results, these results are 

4 sent to the search results form builder 305 (routine 665 in Figure 14B). Routine 667 

5 separates the results based on whether the results are in response to user defined search 

6 criteria or suggested criteria. Routine 668 reads the metadata of each result listing and enters 

7 the metadata into the data fields of a structured search results form 674. The search results 

8 form 674 shown in Figure 19 contains data fields including, but not limited to, program title, 

9 scheduled time of availability, content provider or channel, program type, category, running 

10 time, production date, critical reviews or links to reviews, data concerning frequency and 

11 number of downloads by other users, target audience or content rating, and the general 

12 description including program description, plot line, and cast. The system 200 then accesses 

13 the user's profile and determines if based on user information, account type, and search type 

14 whether advertising is to be incorporated into the display of the search results. If so, select 

15 advertising routine 669 (see Figure 14B) determines what targeted and general advertising is 

16 to be sent and retrieves from the aggregator local database 501 the advertisements that have 

17 not previously been sent to the user and stored in the user terminal 202 for playout. These 

18 advertisements are bundled with the search results form 674 and log results routine 670 logs 

19 the results form and which advertisements were chosen into the user's profile in the 

20 aggregator local database 501. The routine 670 then routes the advertisements and the search 

21 results form 674 through the communications server 250 to the user terminal 202, which 

22 stores and displays the results (display routine 700). 

23 Based on the content search, the user terminal 202 receives the search results form 

24 674 from the communications server 250. Figures 15A and 15B show a display 

25 programming search results process 700 with the search results form 674 being decrypted 

26 and routed to the results processing task internal to the user terminal processor 227, routine 

27 701. The following tasks are all carried out by separate software and/or firmware modules 

28 that are subsystems of the user terminal processor 227. In storage routine 702, the processor 

29 227 stores the search results form 674 in the user local database 213 with a logical link to, or 

30 association with, the search request form 618 that generated the search results. At the same 

31 time, if advertisements are sent to the user terminal 202 by the aggregator 201 for display 
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1 with the results, the routine 702 saves the files to the user local storage 212. After receipt of 

2 the search request form 618, routine 703 displays a prompt and/or activates an audible 

3 notification that the results of a particular search have been received. Based on a user 

4 response to the prompt, routine 704 determines if the results should be displayed at that time. 

5 If the user does not wish to display the results at that time, routine 705 informs the user via 

6 the audio/visual playout systems 208/207 that the results have been stored for later display. 

7 The content displayed on the playout systems (208/207) is then returned to whatever content 

8 was previously being presented, routine 706. The user terminal processor 227 then stops 

9 processing of the results, routine 707. 

10 If the user wishes to view the search results when prompted, translation routine 708 

11 translates the search results form 674 into the default display format. The default display 

12 format can be customized by the user either by manipulating the display and saving the 

13 display as the default user format, or accessing and altering a default display template. At 

14 anytime, the user can revert to the system default format, which may list the program results 

15 in ranked order and may display program attributes including, but not limited to, title, 

16 program availability, program schedule, content provider or channel, content type, 

17 description, program rating, and options for download. In an embodiment, the default results 

18 display includes two sections displayed on-screen with one section displaying results that 

19 match the user's search criteria and the second section displaying suggested results based on 

20 criteria generated earlier in the process by the content search suggestion engine 304. In 

21 another embodiment, one or more sections of the display screen may be dedicated to static or 

22 dynamic advertising. In yet another embodiment, the advertisements may serve as 

23 hyperlinks to more information about a product or service, or directly to advertised content. 

24 The search results display may be in the form of a GUI that will incorporate, in 

25 different sections of the display, various user options including, but not limited to, download 

26 and view a particular program, download program and save to user local storage 212 for later 

27 viewing, re-order results based on a particular attribute such as program type or content 

28 provider, modify or refine search, quit results display, and view other available GUIs. 

29 Routine 710 determines if the user wishes to display additional information about a certain 

30 content listing based on user input and display routine 711 displays the full content 

31 description and selected metadata for the selected content. When the user is finished 
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1 reviewing the additional information, display is returned to the last screen to have been 

2 displayed (routine 711). Routine 712 executes when the user enters a request into the system 

3 200 to download selected content from the results display. Once the request is entered, 

4 storage routine 713 stores the selection information in the user profile section of the user 

5 local database 213 and passes control to routine 714. Routine 714 then performs three 

6 actions: 1) it displays that the download request is being processed; 2) prompts the user to 

7 select another content listing for download; and 3) routes the first download request to format 

8 routine 715, which formats the content download request form 716 along with appropriate 

9 user information for transmission to the aggregator 201. The program download request 

10 form 716 is then encrypted and sent over the wide area distribution system 203 to the 

1 1 communications server 250. 

12 Routine 717 monitors the user input and if the user elects to download more 

13 programming, the routine 717 returns control to the display routine 709, which once again 

14 displays the search results at the video display system 207. If the user does not wish to 

15 download more programming, the routine 717 routes control to routine 718, which 

16 determines from the user input if the user wants to view other on-screen GUI options. If the 

17 user elects to view other on-screen GUI options, display routine 719 displays a status 

18 message that the search results have been saved locally and routine 725 starts the process to 

19 display other system GUIs. If the user does not wish to view other GUIs, the routine 718 

20 routes control to the routine 705, which resumes the programming play out that was 

21 interrupted for the preceding processes. 

22 Figures 16A and 16B show a flowchart showing the processing content download 

23 requests process 750. Once the user terminal 202 has initiated transmission of a download 

24 request, the content download request form 716 is received by the communications server 

25 250 and routed to the request and results processing server 300 (routine 751). Within the 

26 request and results processing server 300, log routine block 752, the request receiver and 

27 router 301 logs the download request with the database administrator 502 in the system 

28 administrator 500, entering the data as part of the user's profile. In routine 753, the system 

29 administrator 500 retrieves information from the user's profile pertaining to the user's rights 

30 to download certain content and execution of routine 754 compares the user data and the 

31 content download request in order to verify that the user is authorized to download the 
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1 requested content. If the user is not authorized to download the requested information, the 

2 system administrator 500, in routine 755, sends a message through the request receiver and 

3 router 301 to the communications server 250 addressed to the user, informing the user that 

4 the request has been denied. The event is then logged with the system administrator 500. 

5 Then the process stops, routine 756. 

6 If the content download request is authorized, execution of the routine 757 encrypts 

7 and routes an authorized download request form 758 to the content acquisition server 400. 

8 Routine 759 then analyzes the metadata associated with the requested content and calls on 

9 the aggregator local database 501 to retrieve appropriate data to verify that the content is 

10 referenced properly within the request and is still available for download from the indicated 

1 1 storage location or streaming source. Routine 760 then determines if the requested content is 

12 to be delivered from a local source or a remote source. If the content is available locally, 

13 processing moves to routine 761, which designates the request as an authorized local 

14 download request form 769 and routes the request to the content delivery server 450 for 

1 5 fulfillment of the download request, process 800. 

16 If the requested content is only available from a remote source, the routine 760 routes 

17 the request to routine 762, which routes the request through the network gateway 251 to the 

18 remote content server 204 designated in the aggregator remote content database 517, The 

19 remote content server 204 then verifies, using routine 763, that the request is authorized and 

20 that the content is still available for delivery. If the content is authorized and available, then 

21 routine 763 returns what is now an authorized remote download request form 768 through the 

22 network gateway 251 to the content delivery server 450 for fulfillment of the download 

23 request, process 800. If the request is not authorized, or if the content is no longer available 

24 for download, routine 764 sends notification to that effect through the network gateway 251 

25 to the system administrator 500 in the aggregator 201. In routine 765, the system 

26 administrator 500 logs the status of the request and the requested programming in the 

27 aggregator local database 501 and the remote content server 204 logs the same information in 

28 the remote server database 260. The aggregator 201 then sends a notification, routine 766, to 

29 the user informing the user that the request cannot be fulfilled and the reason. The process 

30 then terminates with routine 767. 
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1 Once a download request has been processed and authorized, the download request is 

2 forwarded to the content delivery server 450, which fulfills delivery of the content using the 

3 content delivery process 800 shown in Figures 17 A, 17 B and 17C. As an authorized remote 

4 download request form 768 or an authorized local download request form 769 is received, 

5 the content delivery server 450 determines, routine 801, if the request is local or remote, and 

6 routes the request form appropriately (routine 802 for a remote request and routine 819 for a 

7 local request). 

8 If the request is to be fulfilled remotely, execution of the routine 802 transmits a 

9 message to the remote content server 204 to begin delivery of the programming content. In 

10 routine 803, the download request is analyzed and the remote content server 204 determines 

1 1 if the content can be delivered directly to the user without going back through the aggregator 

12 201. If the content is not designated for delivery directly to the user, routine 804 is executed, 

13 which establishes a communications link with the content acquisition server 400 through the 

14 network gateway 251 and starts transmitting the requested programming. In the case of 

15 programming that is airing in real-time, the programming can be in the form of an 

16 audio/video stream from various remote streaming sources 259. Non-real-time programming 

17 can be in the form of compressed audio/video files delivered from remote content storage 

18 258. When the content delivery process commences, execution of routine 806 initiates a 

19 process in the system administrator 500 that analyzes the content metadata and determines if 

20 the programming should be stored at the aggregator local storage 254. The system 

21 administrator 500 may determine to store a particular program locally based on reasons 

22 including, but not limited to, the program being a live event such as a sports event or a 

23 musical concert that will likely be requested for download in the future. Alternatively, the 

24 programming is not stored locally and the current request represents a predetermined number 

25 of users that have requested the content requiring remote delivery. 

26 If the programming being delivered from a remote content server 204 will be stored 

27 to the aggregator local storage 254, the programming metadata is analyzed (routine 807) to 

28 determine if the content is in an acceptable format for local storage. The aggregator 201 may 

29 be configured to store content in one or more specific formats that will balance the highest 

30 quality of programming content to be delivered to the users versus available storage space. 

31 In an embodiment, one or more of the selected storage formats will make the most efficient 
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1 use of the aggregator local storage 254 resources as well as support high-speed delivery to 

2 system users. If the content is determined to meet the format requirements for local storage, 

3 processing passes on to routine 810. If the content does not meet the format requirements, 

4 the content stream and/or files are routed to the decoder and content formatter 252, routine 

5 808. At routine 809, the decoder and content formatter 252 decodes the incoming data and 

6 may extract digital and/or analog data representing the content and its metadata. The decoder 

7 and content formatter 252 then reformats the content into the required formats and coding 

8 schemes for local storage. Upon execution of storage routine 810, the properly formatted 

9 programming content is stored to the aggregator local storage 254. The process and the new 

1 0 location of the content is then logged into the aggregator local database 501. 

1 1 Whether or not the content was stored locally, routine 811 analyzes the programming 

12 content's metadata and determines if the content is in the appropriate format and coding 

1 3 scheme for delivery to the user. The format and coding scheme for delivery may be different 

14 from that used for local storage in order to accommodate particular parameters of a user's 

15 download request. The user may request specific formats and coding schemes due to 

16 considerations including, but not limited to, the method of playback, the type of 

1 7 programming, whether the user intends to store the content, or the type and bandwidth of the 

18 connection the user terminal 202 has to the aggregator 201 or the remote content server 204. 

19 If the content is determined to meet the format requirements for delivery to the user, 

20 processing moves to routine 814, If the content does not meet the format criteria, the content 

21 stream and/or files are routed to the decoder and content formatter 252 by (routine 812) along 

22 with the required formatting and coding parameters. At routine 813, the decoder and content 

23 formatter 252 decodes the incoming data and may extract digital and/or analog data 

24 representing the content and its metadata. The decoder and content formatter 252 then 

25 reformats the content into the required formats and coding schemes for delivery to the user. 

26 Processing then moves to routine 823 for delivery, which is discussed below when that 

27 processing path becomes common to both remote and local content delivery. 

28 Returning to block 803 in Figure 17 A, if the programming content is designated for 

29 direct delivery to the user's terminal, the remote content server 204 establishes a 

30 communications link with the user terminal 202 (routine 815) and delivers the content files or 

31 streams the broadcast program directly to the user terminal 202 (routine 816). After the 



35 



5311 



1 completed delivery is validated during routine 816, routine 817 logs the delivery fulfillment 

2 in the remote server database 260 and notifies the content acquisition server 400 at the 

3 aggregator 201 that the requested programming content has been successfully delivered to 

4 the user. Processing is then moved to the system administrator 500 (routine 826), which is 

5 discussed below, when that processing path becomes common to each delivery type. 

6 If the programming download request is to be fulfilled by the local aggregator 201, 

7 execution of the routine 801 passes processing to routine 819 in the local content request 

8 processor 451 of the content delivery server 450, which analyzes the programming content's 

9 metadata and determines if the content is in the appropriate format and coding scheme for 

10 delivery to the user. If the content is determined to meet the format requirements for delivery 

11 to the user, processing moves to routine 822. If the format and coding scheme is not correct, 

12 execution of the routine 820 retrieves the programming content from the aggregator local 

13 storage 254 or the appropriate local streaming sources 262 and routes the programming to the 

14 decoder and content formatter 252 along with the required formatting and coding parameters. 

15 In routine 821, the decoder and content formatter 252 decodes the incoming data and may 

16 extract digital and/or analog data representing the content and its metadata. The decoder and 

17 content formatter 252 then reformats the content into the required formats and coding 

18 schemes for delivery to the user. Execution of routine 822 takes the correctly coded and 

19 formatted programming content file(s) and/or streams, whether directly from local sources or 

20 from the decoder and content formatter 252, and routes this content to the content delivery 

21 server 450. 

22 Whether the programming content is being delivered by the local aggregator 201 

23 from a remote source or a local source, upon execution of routine 823, the content delivery 

24 server 450 analyzes the user's profile information and the content metadata and, if 

25 applicable, instructs the digital rights management processor 454 to apply the appropriate 

26 DRM scheme to the content delivery. If the DRM scheme involves encrypting the 

27 programming content for delivery, the programming content is routed to the encryption 

28 processor 455, which processes the digital content data through an encryption algorithm 

29 using the appropriate user encryption key and routes the encrypted data back to the content 

30 delivery server 450. 
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1 The content delivery server 450 then analyzes the metadata and user information, 

2 routine 824 and, if applicable, instructs the advertisement processor 456 to incorporate any 

3 advertising into the delivery that is appropriate. The advertising is then retrieved from the 

4 aggregator local database 501 and packaged with the programming content delivery. In an 

5 embodiment, the advertisement processor 456 may have already delivered particular 

6 advertising to the user terminal 202 for storage, and having determined this from the user 

7 data, may insert a placeholder for an advertisement that will instruct the user terminal 202 to 

8 retrieve and display the advertisement at the appropriate time. 

9 Upon execution of routine 825, the content delivery server 450 instructs the 

10 communications server 250 to establish a communications link with the user terminal 202 

11 through the wide area distribution system 203, initiating a content reception process 850. 

12 The content delivery processor 453 delivers the content to the user terminal 202 (routine 826) 

13 through the communications server 250 and wide area distribution system 203. Execution of 

14 routine 827 verifies the correct delivery of the programming content to the user, and when 

15 the delivery is complete, logs the successful delivery with the system administrator 500. The 

16 delivery of content may be done in real-time in the case of broadcast programs and live or 

17 scheduled program streams or can be done in non-real-time where the content is delivered at 

18 a rate higher than that required for real-time viewing and is stored by the user terminal 202 

19 for playback at a time chosen by the user. (See DAVIC 1 .5 Specifications, TV Anytime and 

20 TV Anywhere, Revision 6.0; copyright Digital Audio-Visual Council (DAVIC), hereby 

21 incorporated by reference, for more detail about concurrent viewing and storing, non-linear 

22 playback, non-real-time delivery, and content storage and management.) 

23 Whether the programming was delivered by the local aggregator 201 or by a remote 

24 content server 204, processing moves to routine 828 in the system administrator 500, which 

25 analyzes the user profile and the content metadata to determine whether the user will be 

26 billed or if the content provider is due a fee for the content delivery. If no bills are due, 

27 processing ends, routine 829, If billing or fees are applicable, routine 830 routes user 

28 information, appropriate content metadata, and content provider information to the system 

29 administrator 500, which enters this data into the billing process represented by routine 900. 

30 Prior to content delivery, the programming content may be processed by the coder 

31 and content formatter 253 if required to deliver the content in an appropriate digital coding 
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1 scheme, compression, and content format to the user. The coder and content formatter 253 

2 employs digital compression techniques to increase existing transmission capacity. A 

3 number of digital compression algorithms currently exist or may be developed in the future 

4 that can achieve the resultant increase in capacity and improved signal quality desired for the 

5 system 200. The algorithms generally use one or more of three basic digital compression 

6 techniques: (1) within-frame (intraframe) compression, (2) frame-to-frame (interframe) 

7 compression, and (3) within carrier compression. The coder and content formatter 253 of the 

8 content search, packaging, and delivery system 200 will be able to use any of these 

9 techniques in addition to being able to have its capabilities modularly expanded to include 

1 0 any emerging and future techniques that are determined to be desirable. 

11 In an embodiment, although a single digital compression standard may be used for the 

12 delivery system 200, different levels of compression can be utilized when delivering 

13 programs to a user requesting a particular program. For example, if the program is sent out 

14 using an HDTV format, then less compression is used as opposed to sending out the program 

15 using a standard video format. The reason is that the HDTV format requires more digital 

16 data per portion of content. Since the HDTV format requires more digital data, it will also 

17 require more bandwidth to transmit, possibly increasing the cost of delivery. Therefore, the 

18 quality of the video delivered may be a variable in the fees charged to users of the system 

19 200. 

20 Since programming content can be delivered in more than one way, the user may also 

21 consume the programming in more than one way. Audio /Video Content can be viewed 

22 and/or listened to concurrently with the delivery in the case of a broadcast delivery over the 

23 cable television system as well as during an Internet delivery of a data stream or file that 

24 contains the programming. The user can also store the content as the content is delivered, 

25 whether or not the user consumes the content during the delivery, allowing for non-linear 

26 playback of content at the user terminal 202 either during delivery or at a later time. Non- 
27 linear playback refers to the ability of a user to stop, start, pause, rewind, slowdown, and 

28 speedup the playout of a piece of video or audio content. In an embodiment, programming is 

29 delivered from the system 200 in less time that it would take to consume the programming 

30 and is saved in user local storage 212 for use at any time thereafter. In the case of a real-time 

31 broadcast, the storage method may be onto magnetic tape using an audio/video recording 
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1 system 209 such as a video cassette recorder, or into user local storage 212 as a digital file 

2 such as onto a computer hard disk drive or other digital data storage medium. Once the user 

3 has numerous programs stored in the user local storage 212, the user terminal 202 will 

4 provide the ability for the user to manage content storage and organization through a series of 

5 simple GUIs approximating an audio-video library collection. Storage management may also 

6 be automated using either user-defined or pre-set rules, or both. (See DA VIC 1.5 

7 Specifications, TV Anytime and TV Anywhere, Revision 6.0; copyright Digital Audio- 

8 Visual Council (DA VIC), hereby incorporated by reference, for more detail about concurrent 

9 viewing and storing, non-linear playback, non-real-time delivery, and content storage and 

10 management.) 

11 In an embodiment, the user terminal 202, whether is comprised of a set top terminal 

12 206, a personal computer terminal 211, or some combination thereof, is integrated into a 

13 home network 229 serving the user's home. This will enable the consumption of 

14 programming content at numerous nodes in the home which may consist of auxiliary user 

15 terminals and/or personal computers with various combinations of video display system 207, 

16 audio playout system 208, and audio/video recording system 209. The primary user terminal 

17 202 can route programming search and download requests from other network nodes and 

18 route subsequent downloaded programming to the requesting node either an a baseband 

1 9 video network or a digital data network such as an Ethernet network. Auxiliary nodes may 

20 also have a combination of user input devices 214 to control the system and initiate 

21 programming requests and downloads. In an embodiment, a handheld remote control 225 

22 using wireless radio frequency transmission may control the primary user terminal 202 from 

23 a remote location to deliver programming to a remote video display system 207. 

24 The search, packaging, and delivery system 200 may be a revenue generating system 

25 for its operators and for registered content providers. In addition to revenue that can be 

26 generated from various advertising schemes within the system 200, the system 200 may 

27 optionally support a customer-billing model in which users can be billed in different ways. 

28 Customer billing schemes include, but are not limited to, term fees for basic services, i.e., 

29 monthly billing; subscriptions to various service packages; fees per content download; and 

30 total quantity of downloaded material for a given time period. The customer billing server 

3 1 506 within the system administrator 500 may track services rendered, maintain a user billing 
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1 account, and track user payments for services. In addition, authorization levels can be set to 

2 prevent unauthorized usage. In an embodiment, a single account can have multiple users 

3 with different levels of authorization and content access rights. An example is a large family 

4 with a single account with each family member having a user profile and attendant usage 

5 rights. These usage rights will be administered by the primary user of the account, typically 

6 the head of the household. 

7 In order to provide high quality programming content to the user, many of the content 

8 providers will be entitled to fees for access to premium content, especially copyrighted 

9 content. These fees will be tracked by the content fee and copyright billing server 507 within 

10 the system administrator 500. Content providers will be able to register with the 200 using 

11 software hosted by the content provider registration server 505 within the system 

12 administrator 500. The registration software may collect all relevant data about the content 

13 provider and the content provider's proposed content to be made available to users. Using a 

14 pre-existing fee table, the provider may be informed of the fees to be made available for the 

15 various programming content to be provided. In addition, fees for sufficiently unique content 

16 may be negotiated outside the automated registration process. In an embodiment, the content 

17 fee and copyright billing server 507 may initiate compensation to content providers at 

1 8 scheduled intervals based on the distribution of content for the prior period. 

19 Part of the registration may include furnishing the content provider with software 

20 tools to assist in populating the appropriate metadata fields for new content. For example, an 

21 original television show may need to have its program type, description, cast, and other 

22 information entered into the metadata database in a manner consistent with that in use by the 

23 aggregator 201. In an embodiment, the content provider registration server 505 will run 

24 various algorithms to collect this information automatically from differing content providers' 

25 databases. In another preferred embodiment, the automatic collection may be augmented by 

26 a series of prompt screens for the content provider to manually input the data into the system. 

27 During content registration, and at any time that additional content is made available 

28 by the content provider, the content provider can use the content provider registration server 

29 505 services to designate usage rights for programming content. These rights can be 

30 assigned to individual pieces of content or to groups or classes of content. Usage rights 

3 1 define how a specific user, or tier of users, can use the digital content when it is delivered to 
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the user terminal 202. The defined usage rights for content are then incorporated into the 
digital rights management (DRM) scheme that is applied to the content by the content 
delivery server 450 and may require encryption as part of a secure delivery process. Usage 
rights either prevent or enable a user to perform certain actions with the digital programming 
content including, but not limited to, whether content can be recorded or stored, whether the 
user can make copies of stored content and onto what types of media, whether the content 
can be played back a finite number of times or indefinitely, whether the content can be 
spliced, edited, or imported into another digital processing environment, and whether the 
content can be exported from the system for distribution to a third party. 

When content is downloaded to a user, the content delivery server 450 logs the 
delivery with the database administrator 502, the customer billing server 506, and the content 
fee and copyright billing server 507. The database administrator 502 incorporates the 
information into the user profile and the billing servers determine if the user will be charged 
a fee for the particular content and whether the provider is entitled to a fee for the content. 

Users will be able to register with the system 200 using software hosted by the user 
registration server 504 within the system administrator 500. The user registration software 
will allow the user to perform numerous tasks including, but not limited to, set up the user's 
account, choose a billing scheme, select premium content tiers, enter user profile information 
and preferences, set up multiple user profiles and administer usage rights. At any time in the 
future, the user can access data that is collected for the user profile and can review and revise 
user data, opt out of or terminate data collection, request deletion of user data, and review 
how this data is being used by the system 200. 
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